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DETAILED ACTION 



Continued Examination Under 37 CFR 1.114 



1 . A request for continued examinatibn under 37 CFR 1,114, including the fee set 
forth in 37 CFR 1 .17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1.17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on April 
04, 2003 has been entered. 



2. Applicant's arguments with respect to claims 1-38 and 40-53 have been 
considered but are moot in view of the new ground(s) of rejection. 



3. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 
A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
351(a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and was published under Article 21(2) 
of such treaty in the English language. 



4. Claims 1-5, 8-11, 13-21, 27-36, 40-41, 44-49, and 52-53 are rejected under 35 
U.S.C. 102(e) as being anticipated by Kwoh et al (US 2002/00331331 A1). 

Regarding claim 1 , Kwoh et al discloses a recording unit (Fig. 2) for recording an 
event, comprising: 
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a data acquisition device (camera electronics 204 of Fig. 2, page 2, paragraph 
#0035) for obtaining recording data representing the content of the event; 

a data storage device (tape 212 of Fig. 2, page 2, paragraph #0035) for storing 
data, including recording data; 

a control interface device (controls 216, play 220, record 218, and voice title 222 
of Fig. 2, page 2, paragraph #0035) for enabling a user to control operation of the 
recording unit, the control interface device further comprising marking means for 
enabling the user to specify a non-contemporaneous mark; and 

a system controller (microcontroller 214 of Fig. 2, page 2, paragraphs #0035 and 
#0036) that causes, in response to the specification of a non-contemporaneous mark by 
the user, the data storage device to store marking data associating the non- 
contemporaneous mark with recording data obtained at a marked time different from the 
marking time at which the non-contemporaneous mark was specified by the user; 

wherein the non-contemporaneous mark is specified by the user at the time 
when the recording with which the non-contemporaneous mark is associated is neither 
being obtained by the recording unit nor displayed to the user (page 2, paragraphs 
#0035 and #0036). 

Regarding claim 2, Kwoh et al discloses the claimed wherein the marking means 
is adapted to enable specification of a retrospective mark that is associated with 
recording data obtained at a marked time prior to the marking time at which the 
retrospective mark was specified by the user (pages 2-3, paragraphs # 0036 and 
#0037). 
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Regarding clainn 3, Kwoh et al discloses the claimed wherein the marking means 
is adapted to enable specification of a predictive mark that is associated with recording 
data obtained at a marked time subsequent to the marking time at which the predictive 
mark was specified by the user (pages 2-3, paragraphs #0036 and #0037). 

Regarding claim 4, Kwoh et al discloses the claimed wherein the marking data 
defines the marking time and a duration of time, the marked time being the time 
different from the marking time by the amount of the duration of time (page 2, paragraph 
#0035 and pages 4-5, paragraph #0055). 

Regarding claim 5, Kwoh et al discloses the claimed wherein the marking data 
defines the marking time directly (page 2, paragraph #0035). 

Regarding claim 8, Kwoh et al discloses the claimed wherein the marking data 
further defines a range of time relative to the marked time (page 2, paragraph #0035 
and pages 4-5, paragraph #0055). 

Regarding claim 9, Kwoh et al discloses the claimed wherein the marking means 
is adapted to enable specification of multiple types of non-contemporaneous marks, 
each type of mark having a different meaning (page 2, paragraphs #0032 and #0035). 

Regarding claim 10, Kwoh et al discloses the claimed wherein the marking 
means further comprises: 

means for indicating that a voice mark is to be imminently specified (page 2, 
paragraph # 0035); and 
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means for identifying a voice mark (page 2, paragraphs #0035 and #0036), the 
means for identifying operable in response to an indication that a voice mark is to be 
imminently specified. 

Regarding claim 1 1 , Kwoh et al discloses the claimed wherein the recording unit 
is portable (page 2, paragraph #0034). 

Regarding claim 13, Kwoh et al discloses the claimed wherein the data 
acquisition device further comprises a visual data acquisition device (the monitor 232 of 
Fig. 2, page 2, paragraph #0035). 

Regarding claim 14, Kwoh et al discloses the claimed wherein the data 
acquisition device further comprises an audio data acquisition device (the microphone 
224 of Fig. 2, page 2, paragraph #0035). 

Regarding claim 15, Kwoh et al discloses a portable recording unit (Fig. 2) for 
recording an event, comprising: 

a data acquisition device (camera electronics 204 of Fig. 2, page 2, paragraph 
#0035) for obtaining recording data representing the content of the event; 

a data storage device (tape 212 of Fig. 2, page 2, paragraph #0035) for storing 
data, including recording data; 

a control interface device (controls 216, play 220, record 218, and voice title 222 
of Fig. 2, page 2, paragraph #0035) for enabling a user to control operation of the 
recording unit, the control interface device further comprising marking means for 
enabling the user to specify multiply types of marks; and 
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a system controller (microcontroller 214 of Fig. 2, page 2, paragraphs #0035 and 
#0036) that causes, in response to the specification of a mark by the user, the data 
storage device to store marking data associating the specified mark with particular 
recording data; wherein 

the meaning of one of the multiple types of marks is definable by the user (page 
2, paragraphs #0032 and #0035). 

Regarding claim 16, Kwoh et a! discloses the claimed wherein the multiple types 
of marks include one or more marks that are associated with recording data obtained at 
a time other than the time at which the mark is specified (pages 2-3, paragraphs # 0036 
and #0037). 

Regarding claim 17, Kwoh et al discloses the claimed wherein the multiple types 
of marks include one or more marks indicating a level of importance or interest of the 
content which the marked recording data represents (pages 2-3, paragraphs #0036 and 
#0037 and pages 4-5, paragraph #0055). 

Regarding claim 18, Kwoh et al discloses the claimed wherein the multiple types 
of marks include one or more marks indicating a characteristic of the content which the 
marked recording data represents (pages 2-3, paragraphs #0036 and #0037 and pages 
4-5, paragraph #0055). 

Regarding claim 19, Kwoh et al discloses the claimed wherein the multiple types 
of marks include one or more marks indicating the beginning or end of activity of interest 
(pages 2-3, paragraphs #0036 and #0037 and pages 4-5, paragraph #0055). 
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Regarding claim 20, Kwoh et al discloses the claimed wherein the multiple types 
of marks include one or more marks indicating the recording conditions (pages 2-3, 
paragraphs #0036 and #0037 and pages 4-5, paragraph #0055). 

Regarding claim 21, Kwoh et al discloses the claimed wherein the multiple types 
of marks include one or more marks indicating the user's state of mind (page 2, 
paragraph #0035). 

Regarding claim 27, Kwoh et al discloses the claimed means (page 2, 
paragraphs #0032 and #0035) for enabling the recorder to specify the meaning of one 
or more of the multiple types of marks. 

Regarding claim 28, Kwoh et al discloses the claimed means (page 2, 
paragraphs #0032 and #0035 and page 3, paragraph #0040) for changing the meaning 
of one or more marks. 

Regarding claim 29, Kwoh et al discloses wherein means for changing the 
meaning of one or more marks further comprises: 

means (page 2, paragraph #0035) for analyzing the recording data; and 

means (page 2, paragraphs #0032 and #0035 and page 3, paragraph #0040) for 
changing the meaning of a mark based on the analysis of the recording data. 

Regarding claim 30, Kwoh et al disclosed the claimed wherein the portable 
recording unit further comprises means (microphone 224 of Fig. 2, page 2, paragraph 
#0035 and page 3, paragraph #0040) for obtaining data other than recording data; and 
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the means for changing the meaning of one or more marks further compresses 
means for changing the meaning of a mark based on the data other than the recording 
data (page 2, paragraph #0035 and page 3, paragraph #0040). 

Regarding claim 31, Kwoh et al discloses the claimed one or more marking 
tokens (page 2. paragraphs #0032 and #0035) for enabling a person to specify a 
corresponding type of mark, each marking token adapted to enable physical separation 
of the marking token from the control interface device. 

Regarding claim 32, Kwoh et al discloses the claimed wherein the marking 
means further comprises: 

means for indicating that a voice mark is to be imminently specified (page 2, 
paragraph # 0035); and 

means for identifying a voice mark (page 2, paragraphs #0035 and #0036), the 
means for identifying operable in response to an indication that a voice mark is to be 
imminently specified. 

Regarding claim 33, Kwoh et al discloses the claimed wherein the data 
acquisition device further comprises a visual data acquisition device (the monitor 232 of 
Fig. 2, page 2, paragraph #0035). 

Regarding claim 34, Kwoh et al discloses the claimed wherein the data 
acquisition device further comprises an audio data acquisition device (the microphone 
224 of Fig. 2, page 2, paragraph #0035). 

Regarding claim 35, Kwoh et al discloses the claimed wherein the system 
controller causes, in response to the specification of a mark by the user, operation of 
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the recording unit in a predetermined manner in accordance with the type of the mark 
(page 2, paragraphs #0032 and #0035). 

Regarding claim 36, Kwoh et al discloses the claimed wherein at least one mark 
indicates a level of importance or interest of the content which the marked recording 
data represents (page 2, paragraph #0035). 

Regarding claim 40, Kwoh et al discloses a recording unit (Fig. 2) for recording 
an event, comprising: 

a data acquisition device (camera electronics 204 of Fig. 2, page 2, paragraph 
#0035) for obtaining recording data representing the content of the event, the recording 
data comprising data that may be used by a replay system to provide a user-perceptible 
reproduction of some human-perceptible occurrence that took place during the event; 

a data storage device (tape 212 of Fig. 2, page 2, paragraph #0035) for storing 
data, including recording data; 

a control interface device (controls 216, play 220, record 218, and voice title 222 
of Fig. 2. page 2, paragraph #0035) for enabling a user to control operation of the 
recording unit; 

means (voice title 222 of Fig. 2, page 2, paragraph #0035) for producing a mark, 
wherein the means for producing a mark further comprises means for producing a mark 
and/or supplementing or modifying an existing mark based on the value of, or an 
analysis of, data acquired by the recording unit; and 
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a system controller (microcontroller 214 of Fig. 2, page 2, paragraphs #0035 and 
#0036) that causes, in response to the specification of a mark with particular recording 
data; 

wherein the means fro producing a mark and/or supplementing or modifying an 
existing mark produces, supplements or modifies based on the value of, or an analysis 
of, the data that may be used by a replay system to provide a non-visual, user- 
perceptible reproduction of a non-visual, human-perceptible occurrence that took place 
during the event (page 2, paragraphs #0035 and #0036). 

Regarding claim 41, Kwoh et al discloses a recording unit (Fig. 2) for recording 
an event, comprising: 

a data acquisition device (camera electronics 204 of Fig. 2, page 2, paragraph 
#0035) for obtaining recording data representing the content of the event; 

a data storage device (tape 212 of Fig. 2, page 2, paragraph #0035) for storing 
data, including recording data; 

a control interface device (controls 216, play 220, record 218, and voice title 222 
of Fig. 2, page 2, paragraph #0035) for enabling a user to control operation of the 
recording unit; 

means (voice title 222 of Fig. 2, page 2, paragraph #0035) for producing a mark 
further comprises means for producing a mark and/or supplementing or modifying an 
existing mark based on the value of, or an analysis of, data acquired by the recording 
unit; and 
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a system controller (microcontroller 214 of Fig. 2, page 2, paragraphs #0035 and 
#0036) that causes, in response to the specification of a mark with particular recording 
data; 

wherein: 

the recording unit further comprises means (voice title 222 of Fig. 2, page 2, 
paragraph #0035) for acquiring non-visual, human perceptible data other than recording 
data; and 

the means for producing a mark and/or supplementing or modifying an existing 
mark produces, supplements or modifies based on the value of, or an analysis of, the 
none-visual, human perceptible data other than the recording data (voice title 222 of 
Fig. 2, page 2, paragraph #0035). 

Regarding claim 44, Kwoh et al discloses the claimed wherein the means for 
producing a mark and/or supplementing or modifying an existing mark produces, 
supplements or modifies based on the proximity of the marking time to the marked time 
(page 2, paragraph #0035). 

Regarding claim 45, Kwoh et al discloses for use in a recording unit being used 
by a user for recording an event, a method (Fig. 2) for non-contemporaneously marking 
recording data obtained by the recording unit, comprising the steps of: 

Identifying the specification of a non-contemporaneous mark (voice title 222 of 
Fig. 2, page 2, paragraph #0035); and 

In response to an identification of the specification of a non-contemporaneous 
mark, storing marking data associating the non-contemporaneous mark with recording 
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data obtained at a marked time different from the marking time at which the non- 
contemporaneous mark was specified (page 2, paragraphs #0035 and #0036); 

Wherein the non-contemporaneous mark is specified by the user at a time when 
the recording data with which the non-contemporaneous mark is associated is neither 
being obtained by the recording unit nor displayed to the user (page 2, paragraphs 
#0035 and #0036). 

Regarding claim 46, Kwoh et al discloses the claimed wherein: 

the step of identifying further comprises identifying the specification of a 
retrospective mark (voice title 222 of Fig. 2, page 2. paragraph #0035); and 

the step of storing further comprises storing marking data associating the 
retrospective mark with recording data obtained at a marked time prior to the marking 
time at which the non-contemporaneous mark was specified (page 2, paragraphs #0035 
and #0036). 

Regarding claim 47, Kwoh et al discloses the claimed wherein: 

the step of identifying further comprises identifying the specification of a 
predictive mark (voice title 222 of Fig. 2, page 2, paragraph #0035); and 

the step of storing further comprises storing marking data associating the 
predictive mark with recording data obtained at a marked time subsequent to the 
marking time at which the non-contemporaneous mark was specified (page 2, 
paragraphs #0035 and #0036). 

Regarding claim 48, Kwoh et al discloses the claimed wherein the marking data 
defines the marking time and a duration of time, the marked time being the time 
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different from the marking time by the amount of the duration of time (page 2, paragraph 
#0035 and pages 4-5, paragraph #0055). 

Regarding claim 49, Kwoh et al discloses the claimed wherein the marking data 
defines the marking time directly (page 2, paragraph #0035). 

Regarding claim 52, Kwoh et al discloses the claimed wherein the marking data 
further defines a range of time relative to the marked time (page 2, paragraph #0035 
and pages 4-5, paragraph #0055). 

Regarding claim 53, Kwoh et al discloses the claimed wherein the step of 
identifying further comprises: 

Identifying an indication that a voice mark is to be imminently specified (page 2, 
paragraph # 0035); and 

identifying a voice mark (page 2, paragraphs #0035 and #0036) in response to 
an indication that a voice mark is to be imminently specified. 

Claim Rejections - 35 USC § 103 
5. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

This application currently names joint inventors. In considering patentability of 

the claims under 35 U.S.C. 103(a), the examiner presumes that the subject matter of 

the various claims was commonly owned at the time any inventions covered therein 

were made absent any evidence to the contrary. Applicant is advised of the obligation 
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under 37 CFR 1 .56 to point out tlie inventor and invention dates of each claim that was 
not commonly owned at the time a later invention was made in order for the examiner to 
consider the applicability of 35 U.S.C. 103(c) and potential 35 U.S.C. 102(e), (f) or (g) 
prior art under 35 U.S.C. 103(a). 

6. Claims 6-7 and 50-51 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Kwoh et al (US 2002/0031331 A1) in view of Abecassis ('814). 

Regarding claim 6, Kwoh et al discloses all the features of the instant invention 
as discussed in claim 1 above except for providing that the marking data further defines 
a confidence level that represents the certainty of the recorder that the marked 
recording data is the recording data that the recorder desires to mark. 

Abecassis teaches a variable-content video retriever having means for marking 
data defines a confidence level that represents the certainty of the recorder that the 
marked recording data is the recording data that the recorder desires to mark (cols. 8- 
9). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to incorporate segmenting the video signal into G, PG, PG-13, R, NC-17 rating 
segments as taught by Abecassis into Kwoh et al's system in order to prevent an 
unauthorized viewer to watch recorded video signal. 

Regarding claim 7, Abecassis teaches the claimed wherein the value of the 
confidence level defines a range of time relative to the marked time (cols. 8-9). 

Method claims 50-51 are rejected for the same reasons as discussed in 
apparatus claims 6-7 above. 
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7. Claims 37-38 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Kwoh et al (US 2002/00331331 A1) in view of Cruz et al C032). 

Regarding claim 37, Kwoh et al discloses all the claimed features of the instant 
invention as discussed in claim 36 above except for providing the claimed wherein the 
system controller causes recording data corresponding to the at least one mark to be 
compressed in accordance with the level of importance or interest represented by the 
mark, 

Cruz et al teaches a system and method for recording, playing back and 
searching multimedia event wherein video, audio and text can be searched and 
retrieved having means for indicating that a voice mark is to be imminently specified 
(col, 6, line 55 to col. 7, line 37) and that the system controller causes recording data 
corresponding to the at least one mark to be compressed in accordance with the level of 
importance or interest represented by the mark (col. 6, lines 37-54). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to incorporate the searching apparatus as taught by Cruz et al into Kwoh et 
al's system in order to searching the desired audio signal in multimedia data. 

Regarding claim 38, Cruz et al discloses the claimed wherein the system 
controller causes compression of recording data to be reduced after the predetermined 
amount of time (col. 6, lines 37-54). 

8. Claim 12 is rejected under 35 U.S.C. 103(a) as being unpatentable over Kwoh et 
al (US 2002/0031331 Al) in view of Horio et al (*876). 
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Regarding claim 12, Kwoh et a! discloses all the features of the claimed invention 
as discussed in claim 1 above except for providing means for mounting one or more 
components of the recording unit on the body of the user. 

Horio et al teaches a electronic camera having means for mounting the recorder 
on the person of the recorder (Fig. 5) to ease the user in carrying the recorder from one 
place to another. 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to incorporate means for mounting the recorder on the person of the recorder 
as taught by Horio et al into Kwoh et al's system in order to ease the user in carrying the 
recorder from place to place. 

9. Claims 22-23 and 43 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Kwoh et al (US 2002/0031331 Al) in view of Murphy et al (US 6.282.362 B1). 

Regarding claim 22. Kwoh et al discloses all the features of the claimed invention 
except for providing wherein the multiple types of marks include one or more privacy 
marks. 

Murphy et al teaches digital memory storage has an additional advantage over 
conventional video or film recording of images and locations in that encryption of the 
image and location data may be done in such a way that the data could be securely 
protected against subsequent alteration, for example, by locking the recorded 
image/location data file against rewriting, thereby providing a more defensively robust 
legal record (col. 6, lines 56-62). 
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It would have been obvious to one of ordinary skill in the art at the time of the 
invention to incorporate the capability of encrypting (one or more privacy marks) the 
digital data recorded on the digital memory storage as taught by Murphy et a! in order to 
securely protected against subsequent alteration of the recorded data. 

Regarding claim 23, Murphy et a! teaches the claimed wherein the one or more 
privacy marks includes a mark that indicates that the marked part of the recording is to 
be erased (col. 6, lines 56-62). 

Regarding claim 43, Murphy et al also teaches the digital data recording unit 102 
having the claimed wherein the means for acquiring data other than recording data 
further comprises a position sensing device (geographical position detector (GPD) 110 
disclosed in col. 8, lines 45-54) for storing video data and position data. 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to incorporate the capability of recording the position data along with the 
image signal as taught by Murphy et al into Kwoh et al's system in order to increase the 
flexibility of the system of Kwoh et al by recording position data along with the image 
video signal. 

10. Claims 24-26 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Kwoh et al (US 2002/0031331 Al) in view of Konishi ('381). 

Regarding claim 24, Kwoh et al discloses all the features of the instant invention 
except for providing the claimed wherein the multiple types of marks include one or 
more marks indicating different recording units. 
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Konishi teaches that, with the electronic camera, it is possible to easily record 
various other data, such as date of photographing, shutter speed, aperture value, frame 
number, place of photographing, name of photographer and object, and various kinds of 
memo data or the like, on the same recording medium on which the object image 
information is recorded, by converting the data to electric signals so that, in the scientific 
field, the system can be study by using said various other data (col, 1. lines 35-68), 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to incorporate the capability of recording data such as date of photographing, 
shutter speed, aperture value, frame number, place of photographing, name of 
photographer and object, and various kinds of memo data or the like on the same 
recording medium along with the image data as taught by Konishi into Kwoh et al's 
system in order to determining whether to improve the system of Kwoh et al by studying 
said data. 

Regarding claim 25, Konishi further teaches the claimed wherein the multiple 
types of marks include one or more marks identifying the person making the mark (col. 

I, lines 35-68). 

Regarding claim 26, Konishi discloses the claimed wherein the multiple types of 
marks include one or more marks identifying a person appearing in the part of the 
recording represented by the recording data associated with the mark (col. 1, lines 35- 
68). 

I I . Claim 42 is rejected under 35 U.S.C. 103(a) as being unpatentable over Kwoh et 
al (US 2002/003331 Al) in view of Nickles ('335). 
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Kwoh et al discloses all the features of the instant invention except for providing 
wherein the means for acquiring data other than recording data further comprises a 
physiological monitoring device; and the means for producing a mark and/or 
supplementing or modifying an existing mark produces, supplements or modifies based 
on the value of, or an analysis of, physiological monitoring data. 

Nickles teaches, in hospital for diagnostic and research purposes, a device for 
the multiplexing of time varying amplitude physiological data signals with the signals 
that are provided to a data processing computer from the photomultiplier tubes of a 
gamma ray camera (col. 1, lines 13-23 and col. 2, lines 52-63). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to incorporate the capability of multiplexing of time varying amplitude 
physiological data signals with the signals that are provided to a data processing 
computer from the photomultiplier tubes of a gamma ray camera as taught by Nickles 
into Kwoh et aVs system in order to study the image signal by using the physiological 
data. 

1 2. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Thai Iran whose telephone number is (703) 305-4725. 
The examiner can normally be reached on Mon. to Friday, 8:00 AM to 5:30 PM. 

The fax phone numbers for the organization where this application or proceeding 
is assigned are (703) 872-9314 for regular communications and (703) 872-9314 for 
After Final communications. 
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Any inquiry of a general nature or relating to the status of this application or 
proceeding should be directed to the Technology Center 2600 Customer Service Office 
whose telephone number is (703) 306-0377. 



TTQ 

June 13, 2003 



